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This paper introduces real time inverse arithmetic coding and user interfaces based thereupon. 
The main idea is that information-efficient data entry can be achieved by ensuring that each 
input's associated display space and ease of selection are at all times related to the input's proba- 
bility of being selected. As with data entry based on inverse arithmetic coding, the layout initially 
depends on the probabilities of the possible inputs; however, real time inverse arithmetic coding 
differs in that the user's actions are interpreted not to navigate this probability distribution but 
rather to modify it according to a learned update rule, which approximates the conditioning of 
the probability distribution on the user's actions. Potential applications of real time inverse arith- 
metic coding include text entry, file browsing, integrated multi-program user interfaces, assistive 
technologies for users with movement disabilities, and ergonomic input methods. 

Categories and Subject Descriptors: H.5.2 [Information Interfaces and Presentation]: User 
Interfaces — Interaction styles; Theory and methods; User-centered design; K.4.2 [Computer and 
Society]: Social Issues — Assistive technologies for persons with disabilities; K.8.1 [Personal 
Computing]: Application Packages — Word processing 

General Terms: Design, Human factors, Theory 

Additional Key Words and Phrases: Data entry, inverse arithmetic coding, user interface 

1. INTRODUCTION 

Concepts from information theory are generally applicable to all forms of communi- 
cation, including that between computers and their users. For example, arithmetic 
coding has been particularly fruitful in inspiring Dasher, an information-efficient 
data entry device based on inverse arithmetic coding (IAC) [ Ward et al. 20 00 . The 
key concept of IAC data entry is that, if each input's selection ease (i.e. the paucity 
of information required to make the selection) and proportion of display space are 
related to its probability of selection, the rate of information transfer between the 
computer and human is enhanced in both directions: the computer can more rapidly 
convey information about possible inputs to the user, and the user can more rapidly 
convey information about choices from among these inputs. Applicable not only 
to text entry, IAC is a general concept (Fig. [TJA.) that can be used in designing 
and improving interfaces through which users communicate data and instructions 
to machines. 

However, IAC methods are currently limited in that the probability distribution 
and consequent layout are never updated to reflect the user's actions, which instead 
serve only to navigate within the original layout of possible inputs. This limitation 
prevents IAC from fully optimizing the extent to which the probability of an input 
is reflected in its proportion of display space and selection ease, and the rate of 
information transfer between the user and the computer is reduced accordingly. The 
situation can be improved if the probability distribution used for IAC is updated 
in real time in response to the user's actions; this concept of real time inverse 
arithmetic coding (RTIAC), depicted schematically in Fig. [TJ3, and its possible 
implementations and applications are the focus of this paper. 
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Fig. 1. (A) IAC and (B) RTIAC data entry schemes. Black arrows indicate immediate effects; gray 
arrows indicate slower learning effects. In both schemes, the initial input probability distribution 
determines the initial layout and thus influences the user's actions, and the statistics of the user's 
selections are used to refine the initial input distribution. In IAC, the user selects the input by 
navigating amongst the displayed initial input distribution. In RTIAC, the user's actions modify 
the input distribution in real time according to a learned update rule, and the display is modified 
accordingly; an input is selected once its probability exceeds a given threshold. 

2. INVERSE ARITHMETIC CODING DATA ENTRY 
2.1 Overview 



Data entry using IAC, introduced by Ward et al. 2000] , is based on arithmetic 



coding of strings [Witten et al. 1987] , Given an ordered alphabet A, a probability 
distribution on A* (the set of finite strings over A), and a termination symbol r, 
each string s £ A* U (A* ■ r) is assigned an interval I s = [a s ,b s ) according to the 
following rules 

( a ) U oe ^u{r} J a = I ' 1 )' 

(b) for each s £ A* , U a eAu{r} !*-a = ^, 

(c) for each s £ A* and a, b £ AU {r}, if a < b, x £ I s . a , and x' £ I s .b, then x < x', 

(d) 6 8 -a 8 = E s -eA.^'4 

Essentially, the unit interval [0, 1) is divided into disjoint subintervals each corre- 
sponding to the possible first characters, each subinterval is then recursively divided 
into further disjoint subintervals corresponding to the subsequent character, the in- 
tervals are ordered according to the dictionary ordering of the corresponding strings, 
and the length of the interval for each string in A* is equal to the combined prob- 
ability of all strings beginning with the corresponding string. These rules define a 
unique mapping from strings to interval subsets of [0, 1). 

In IAC data entry, as realized in the text entry program Dasher (Fig. [2]), the 
user navigates a visualization of the unit interval by cursor-controlled transla- 
tion and zooming until the interval corresponding to the desired input is found 
[Ward et al. 2000] , The sizing of intervals in relation to the probabilities of an 
input string provides two advantages that increase the rate of data entry: First, 
likely entries are easy to find and can be selected quickly without the user having 
to convey much information. Second, since the probability of selection is uniformly 



1 Notation: |J denotes a disjoint union, s ■ s' the concatenation of s with s' , P(s) the probability 
of string s, and A* ■ t the set {s \ s = s't for some s' 6 ,4*}. 
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Fig. 2. The Dasher text entry program 
[The Das her Project 2010 . Each character is 
associated with a square, and strings are displayed 
by nesting the square of each subsequent character 
within that of the previous one. Placement of the 
cursor above or below the center causes the display 
to scroll in the respective direction; placement of 
the cursor to the right of center causes the display 
to zoom in, while placement to the left of center 
causes the display to zoom out. Movement of the 
cursor directs the end of the line toward the desired 
character string. Essentially, the user navigates by 
pointing with the cursor at the desired input. 



distributed on the unit interval and thus over the vertical axis, the user is equally 
likely to move the cursor to each height on the screen and thus communicates in- 
formation to the computer at a relatively rapid rate; the computer can then discern 
the user's choice more quickly than if the user were most likely to select from a more 
restricted proportion of the screen. With these advantages, the Dasher program 
allows for reasonably fast text entry with a low error rate when controlled by either 
mouse (Ward et al. 2000] or eye tracker |Ward and MacKay 2002| . 

2.2 Limitations 

IAC data entry is limited by the fact that the user's actions serve only to locate the 
desired input within the visualization of the prior distribution; such a fixed navi- 
gation scheme prevents the computer from attaining the full information provided 
by the user's actions and maintaining a display layout that accurately reflects the 
input probability distribution. As a result, the optimal conditions for rapid infor- 
mation transfer and data entry deteriorate once the user begins navigating the IAC 
interface to select an input. 

These limitations are best seen through examination of the Dasher navigational 
scheme, according to which the vertical component of the cursor position causes 
traversing of the probability distribution while the horizontal component causes 
zooming in and out (Fig. [2]). The combined effect of the horizontal and vertical 
motions is that the screen continuously zooms in on the region to which the cur- 
sor is pointing. The proportion of display given to each input is uniformly scaled 
within a certain region near the cursor and vanishes outside of that region. How- 
ever, there is still a non-zero probability that the user will select an input that has 
fallen outside of the displayed region due to earlier erroneous cursor movements. 
This particular discrepancy between the input probabilities and the display layout 
requires that the interface allocate specific cursor positions to zooming out. Al- 
though the probability of the desired input being outside the displayed region is 
typically much less than half, all of the cursor positions to the left of the display's 
center correspond to zooming outwards. Other discrepancies include that uniform 
zooming does not reflect the higher likelihood that the user will pick the input co- 
incident with the cursor than the input either above or below it, and that the rate 
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Table I. Comparison of the linear, circular, proportional area, and tree display layouts. 



layout 


linear 


circular 


prop, area 


tree 


area scaling 


p(x,t) 2 


p(x,t) 2 


p(x,t) 


~ p(x,t) 


branching/ nesting 


left-to-right 


radial 


inwards 


along branches 


ordering 


top- to-bottom 


left- to-right 


rows /2D 


varies 


cursor angles used 


90° 


360° 


360° 


360° 


dimensions indicating choice 


1 


1 


2 


2 



of zooming as a function of the cursor's horizontal component will not necessarily 
reflect the proximity of the cursor's vertical component to the desired input. 

3. REAL TIME INVERSE ARITHMETIC CODING 

3.1 Main concept 

The limitations of I AC data entry arise from the fact that, while the arithmetic cod- 
ing scheme may faithfully reflect the probability distribution of character strings 
prior to any user input, it less accurately reflects how this probability distribu- 
tion is modified by the user's actions. Thus, although IAC has certain optimality 
properties at the initial time, these advantages are diminished as time progresses. 

For the user interface to maintain optimality throughout time, each input's 
amount of display space and ease of selection must always reflect the current input 
probability distribution. Thus, while IAC data entry uses only a single initial prob- 
ability distribution, an improved approach requires a time dependent probability 
distribution with its frequency function given by 

p(x,t)=p(x\I t ), (1) 

where p(x\It) denotes the conditional probability that the desired input is x given 
the user's actions It up to the current time t. At each instant, this conditional dis- 
tribution can be used to determine the current layout just as the initial probability 
distribution determines the initial layout for IAC data entry. Thus, as diagram- 
matized in Fig. [Tj3, the user's actions do not navigate within the visualization of 
the probability distribution but rather serve to refine the probability distribution 
underlying this visualization. Methods following this approach will henceforth be 
referred to as real time inverse arithmetic coding (RTIAC). 

Switching the focus from the prior probability distribution used in basic IAC 
schemes to the time-dependent conditional distribution discussed above allows for 
development of user interfaces with better information theoretic properties. Specif- 
ically, the full information contained in the user's action is used by the interface. 
As a result, the proportion of display area and ease of selection can remain related 
to each input's probability throughout time. 

3.2 Interface designs 

The RTIAC concept is not specific to any particular user interface. Nevertheless, 
since the usefulness of RTIAC depends on effective interface designs, a necessarily 
incomplete discussion of this topic is warranted. 

3.2.1 Display layouts. For user interfaces involving visual displays and contin- 
uous user actions (e.g. cursor movements), the ideal display layout satisfies the 
following properties: each input's display region size and selection ease are propor- 
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tional to its probability, these regions change continuously in a way that the user 
can easily follow, the user is induced to make a large variety of actions with even 
probability to maximize the rate at which information is communicated to the com- 
puter, and the natural organization of the data being entered is reflected visually. 
The layout schemes presented below each have different strengths and weaknesses 
in satisfying these requirements (Table HJ; none is optimal in all regards. 

The linear layout (Fig.[3]A.) is that developed for Dasher [Ward et al. 2000] . The 
unit interval is stretched along the vertical axis of the display, and inputs are given 
rectangles with heights and widths both proportional to their probability. The lin- 
ear layout is amenable to data that are naturally ordered and tree-structured; such 
data include character strings, file directories, and locations within documents with 
parts, chapters, sections, and subsections. Entries are ordered linearly along the 
vertical axis, and the tree branches along the horizontal axis. For text entry, the 
left-to-right (or alternatively top-to-bottom) branching of the tree is advantageous 
for those used to reading character words in this orientation. A major drawback of 
this scheme is that the displayed inputs can become quite crowded for two reasons: 
the possible inputs are displayed only along the right quarter of the screen perime- 
ter, and the area allotted to each input scales with the square of its probability 
rather than the probability itself. Information flow from the user is restricted by 
the fact that the cursor will be positioned predominantly within 45 degrees of the 
right horizontal semi-axis. 

The circular layout (Fig. 03) corrects this latter problem by casting the unit 
interval into a circled about the display's center so that the user is equally likely 
to move the cursor toward each angle. To each input string x is assigned the re- 
gion outside an arc traversing an angle of 2irp(x, t) and with radius dependent on 
p(a;,t)H Although the area of each input's region still scales (in the limit of small 
probabilities) with the square of the input's probability, the scaling coefficient is 
improved on account of the larger screen perimeter. The circular layout main- 
tains all the advantages of the linear layout, except for the consistent left-to-right 
(or top-to-bottom) directionality; nevertheless, a consistent radial directionality is 
maintained. 

In the proportional area layout (Fig. EP), each input has a region whose area 
is proportional to the input's probability. It is simplest to maintain this condition 
throughout time if one assumes that the user indicates the x and y coordinates 
of the desired input independently of each other; this assumption, which can be 
generalized for three-dimensional displays, ensures that regions that are initially 
rectangular remain so. Such rectangular shapes are convenient for displaying text 
and images in a manner that is easily viewed. In improving the relationship between 
probability and region area, the proportional area layout loses its suitability for dis- 
playing a simple linear ordering, which must be folded into either rows or columns 



2 To fit a standard rectangular display, the circle must be distorted. For simplicity, the discussion 
in this paragraph is presented in terms of the circle prior to distortion. 

3 In Fig- E]3, the radius r(p(x,t)) is given by the inverted parabola r(p) = cq + y/ci + C2P, with 
the coefficients c; chosen such that r(0) = 0, r(l) = 1, and r'(0) = 2ir. The last condition on the 
derivative sets the rectangular region's aspect ratios to unity in the limit of small probabilities. 
The widths of the rectangular regions in Fig. [3E-F have been calculated similarly. 
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Fig. 3. Display layouts. A. Linear layout with dotted lines indicate regions associated with each 
of ten discrete inputs. B. Circular layout with single indicator for data entry with a single timed 
action. C. Proportional area layout. D. Tree layout. E. Folded linear layout for data entry 
with three discrete timed actions. F. Linear layout scrolling across a smaller display with a fixed 
indicator for timing-based input. The arrows indicate direction of motion, and the symbols ' [ ' 
and ' ) ' indicate the beginning and end of each representation of [0, 1). 



or lost completely. However, in cases where the user must select pairs of two statisti- 
cally independent input characteristics (e.g. points in two dimensions, independent 
and dependent variable values from an experiment, musical note pitches and du- 
rations), the proportional area layout can suit the natural ordering by having one 
axis correspond to the first element of the pair, and the other axis select the second; 
this is the situation in Fig. [3]C. Tree organization of the inputs is reflected in the 
nesting of some regions within others. 

When the possible inputs are organized hierarchically but otherwise unordered, 
they can be visualized as a tree rooted at the center of the display (Fig. |3t>), with 
nodes being displayed only when their associated inputs have probabilities exceed- 
ing some threshold. Various algorithms can be used to position the nodes such 
that the each input's probability is approximately proportional to the display area 
nearest to the associated node and its descendents. One possibility have simulate 
a dynamical system in which nodes repel each other to an extent dependent on 
their associated inputs' probabilities and in which edges provide an attractive force 
between between the nodes they connect. 

In the proportional area and tree layouts, both directions of cursor movement 
tend to indicate the most probable input selection, since either each region or each 
node respectively has a position in two dimensions. This situation contrasts with 
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the linear and circular layouts in which the most likely input tends to be indicated 
primarily by the vertical and circumferential motions respectively, while the second 
dimension tends to provide information about the variance of this input selection. 

3.2.2 Discrete actions. RTIAC can also be implemented with user interfaces 
in which the user makes discrete rather than continuous actions. To allow a user 
to communicate with the timed performance of just a single action, such as the 
pressing of a button, an indicator continually traverses the visualized unit interval 
can be added to the linear or circular layout (Fig. 03). The user attempts to signal 
when the indicator coincides with the desired input, and after each signal the in- 
put probability distribution is updated based on the statistics of the user's timing 
errors; as well, the indicator's scrolling speed could be adjusted until the rate of in- 
formation transfer were maximized. Since only one dimension is used for indicating 
the selection choice, it may be advantageous to fold the linear layout into columns 
(Fig. in order to extend the axis along which selection is made. Alternatively, 
with the rectangular layout, both dimensions can be used in selection provided that 
the axis scanned by the indicator alternate with each signaling event. For small 
displays, it may be advantageous to scroll the input choices rather than move the 
indicator so that the whole visualization of the input probability distribution need 
not be displayed simultaneously (Fig. [Sp). 

When multiple discrete actions are possible, the preferable interface design will 
generally depend on the number of distinct actions. For example, if just a few 
actions are available, having one moving indicator correspond to each action (Fig. 
05) may be desirable. Whereas if many distinct actions are possible, permanently 
associating each action with a fixed subset of the unit interval (Fig.[3K) may be more 
effective. With this latter method, which may also be preferred by users for whom 
precise timing is difficult, correct application of RTIAC implies that each action 
is interpreted not as selecting the associated subset of [0, 1) but rather, since the 
user makes mistakes, as increasing the probability that the input is in that subset. 
This distinction is especially important when a great variety of discrete actions are 
possible because mistakes should occur more frequently under such circumstances. 

3.3 Learning considerations 

Without loss of generality, the learning task can be discussed in the case that the 
user is specifying a number x chosen uniformly at random from the unit inter- 
val. At each time t, one can consider the transformed variable y(x, t) = J Q p(x,t), 
where p(x, t) denotes the estimated probability of input x at time t. The learning 
task is then to determine p{y 1 t + St) = p(y\It+5t), the probability density that the 
transformed variable was y at time t, conditional on the user's actions up to time 
t + St. Since the user acts in response to the displayed position of the desired input, 
which is solely dependent on the transformed variable, the transformation from x 
to y(x,t) makes the density p(y\I t +st) invariant under temporal translations and 
dependent only on the user's more recent actions. If the probability distribution is 
conditioned on / t T + ^ t , the user's actions within only the most recent r time units, 
instead of on It+st i then the dimensionality of the learning problem is reduced and 
the learning algorithm can be presented with identically distributed examples at a 
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rapid rateQ The choice of the time interval length r is a trade-off between retain- 
ing more information and reducing the dimensionality of the probability density 
function that must be learned. 

The most natural learning approach begins with recording the data pairs (y, I[ +St ^ 
of the values ultimately selected and the user's actions. Kernel density estimation 
can then be applied to obtain a smooth joint density p s , which can be reweighted as 
p(y, It+st) — Ps{y, It+st)/Ps(y) t° ensure that the marginal density p(y) is indepen- 
dent of y in accordance with the definition of this transformed variable. The RTIAC 
procedure can then use the estimated conditional probability density p(y\It + $ t ) ■ 

Although non-parametric methods, such as that above, reduce the bias of the es- 
timated conditional probability density, restriction of the hypothesis space provides 
allows for both faster learning (i.e. reduced variance) |Cucker a nd Smale ~2001j and 
less intensive computation of the posterior distribution. For example, the proba- 
bility p(x,t) of input x G [0, 1) could be restricted to obey the equation 

d . + . exp(-||r t (x),r(/-)H 2 /2a 2 (/n) , 
—p{x, t) = — ; 1 (2) 

dt / 1 cxp(-||r t ( 2/ ),r(/nil 2 /2 ( T 2 (^))dy 

where r t (x) is a point in some space X, ||-, - || is an appropriately chosen distance 
function on X, and the learned functions r(I[) and cr 2 (/ t r ) correspond roughly to 
the point indicated by the user and the uncertainty of this indication respectively. 
For cases in which X corresponds to the display space and thus r t (x) is the position 
at which x is displayed, learning could be accelerated by imposing vertical and/or 
horizontal reflection symmetries; when X is a circle (as in Fig. 03), rotational sym- 
metries could similarly be applied. Where such symmetries are only approximate, 
it may be advisable to gradually reduce the degree to which they are imposed in 
order to benefit from both faster learning at early times and reduced bias at later 
times when more data has accumulated. 

Often, reasonable initial estimates for the conditional probabilities p{x, It) should 
permit learning to occur simultaneously with task completion and without any 
prior training. However, in cases of severe disabilities ( fl4.4j) or atypical data entry 
devices f ^4.5l) . learning may have to be initiated with specialized training trials 
until sufficient accuracy is achieved to make online learning feasible. 

4. APPLICATIONS 

The generality of RTIAC offers a myriad of potential applications; this section aims 
to present a few salient and illustrative examples. 

4.1 Simple data entry 

RTIAC can be applied to many tasks in which the user must continuously enter 
data of a single type. The obvious example is a RTIAC _Das/ier-type text entry pro- 
gram (Fig. S]), which could be opened to enter text files, or could be automatically 
called whenever the user must enter a character string, be it a URL, file name, 
email address, etc. As discussed by the developers of Dasher [Ward et al. 2000] 



4 Although examples can be generated arbitrarily often, there is limited value in generating many 
examples in a time interval over which the user's actions are strongly coherent. 
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Fig. 4. A possible text-entry inter- 
face based on Dasher but implementing 
RTIAC. The possible inputs are allotted 
space such that the probability density of 
the user choosing a given angle is uniform. 
The inputs are ordered as in Dasher, be- 
ginning above the the gray line segment 
indicates and wrapping around the circle 
to end below it. The character in the mid- 
dle of the display corresponds to the last 
entered letter shown above the radial lay- 
out. Characters colored in gray cannot be 
selected without the deletion of characters 
already entered; the number of characters 
that will be deleted before a gray charac- 
ter is selected is indicated by the number 
of dashed arcs separating the gray char- 
acter from the center of the display. The 
end of the gray line segment indicates the 
cursor position. 



Ward and MacKay 2002 , such a text entry device, although slower than a tradi- 
tional keyboard, is advantageous for use on personal data assistants, by mobility 
impaired users, or with alphabets not well suited to keyboards. The expected im- 
proved speed of RTIAC relative to IAC data entry may increase the situations in 
which such a text entry device is useful. Similar programs could be developed for 
entering other types of data such as music notation, as discussed in §3.2.11 

Computer files organized in directories have ordering and tree structure similar 
to character strings; therefore, the same type of program could be used for browsing 
directories and selecting files. Since the expected time required to select a particular 
file would depend on the frequency of the file's use rather than its depth within 
a directory, such a method of file browsing would eliminate the usual trade-off 
between quick file access and helpful organization of files into many informative 
sub-directories. Analogous remarks are applicable to the selection of commands 
from a program's menus (File, Edit, View, etc.), programs from an application 
launcher, places in a sectioned document such as an HTML documentation file, or 
music within an organized collection. 

In other cases, for example the selection of icons on a desktop or files in a large 
directory, there is no natural hierarchical structure among the possible inputs. The 
lack of such nested structure removes the advantages of the radial and linear layouts 
and suggests use of the proportional area layout (Fig. [3p). 

4.2 Wider scope interaction 

Interfaces using RTIAC can also be applied to tasks of wider scope than the contin- 
uous entry of data into a single file or field. A modest extension of a basic RTIAC 
text entry device along these lines could some basic navigation and editing com- 
mands (backspace, delete, arrows keys, etc.) among the input options presented 
to the user. In addition to allowing the user to quickly manipulate written text as in 
a normal text editor, the underlying IAC model for such a program could facilitate 
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such predictable input sequences as one backspace followed by a few others to fully 
eliminate a word. Commands for movement between cells could also make such an 
interface suitable for entering data into spreadsheets. 

More ambitiously, one could imagine a RTIAC-based user interface for an entire 
program, multi-program suite, or operating system. Since users give commands 
to computers sequentially, an underlying IAC model could be developed in the 
same way as for strings of sequential alphabet characters. Such an interface would 
facilitate transitions between predictably sequential tasks within a single program 
(e.g. printing from a word processor followed by saving the file and exiting the 
program) or multiple programs (e.g. closing the only open program window followed 
by either initiating another program, browsing the file directory, or logging out). 

4.3 Suboptimal data entry devices 

RTIAC approaches can be especially helpful when data entry would be otherwise 
unreliable. Unlike IAC interfaces, which respond in a fixed way to the user's actions, 
RTIAC interfaces could learn the specific nature of the entry device's ambiguities 
and adjust its responses accordingly. For example, by interpreting the touching of a 
screen location to increase the probability of nearby inputs rather than to make an 
immediate selection, RTIAC interfaces could prevent the frequent errors occurring 
when users must select between closely spaced icons on a touchscreen or must click 
on the correct button with an overly sensitive touch-pad mouse. 

Hybrid schemes could be developed for interfaces intended for one-time or in- 
frequent users who would not want to learn a new navigation scheme. For such a 
text entry device, a standard keyboard layout or array of buttons could be initially 
displayed with equal-sized buttons; the user's actions could then serve rescale the 
two axes as in the proportional area layout, and the original keyboard could be 
displayed again after each unambiguous key selection. In this way, the infrequent 
user need not learn to read nor to navigate the less intuitive layouts of £13.2.11 

4.4 Users with disabilities 

IAC data entry methods have already benefited disabled computer users by facil- 
itating data entry without the use of a keyboard, for example by tracking gaze 
direction |Ward ari d MacKay 2002 . RTIAC schemes have the potential to provide 



these benefits in a potentially more effective manner by using the information pro- 
vided by the user's limited actions to the fullest extent at all times. With the 
variety of possible layouts discussed earlier, the advantageous of RTIAC could be 
enjoyed not only by those capable of performing continuous actions fi j3.2.1[) , but 
also by those capable of only timed or untimed discrete actions ( ^3.2. 2p . 

Beyond extending the benefits of IAC approaches, RTIAC also provides its own 
unique benefits to disabled users. By learning to respond optimally to the actions 
of individual users, RTIAC interfaces would adapt to users capable of using an 
input device with only limited efficacy. Although able to move a mouse or joystick, 
users with certain movement disorders would be unable to avoid frequent erroneous 
inputs when using an IAC interface with a preset navigation scheme; in contrast, 
RTIAC interfaces would adapt to these users' poorly controlled motions and then 
continually update the layout to accurately reflect the information revealed by each 
action. Users whose restricted motion prevents them from directing the device in 
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a particular direction would likewise be accommodated by RTIAC interfaces. 
4.5 Atypical input devices 

Three factors enable RTIAC to better use ambiguous input media, such as live video 
or sound recording, with which it is less clear which aspects of the user's actions 
indicate the input intentions. First, since a user's action serves to update the input 
probability distribution rather than immediately select an input, the computer is 
not required to determine the user's intent from a single action, and the user can 
correct for any misinterpretations with subsequent actions. Second, the interface 
need not learn to recognize new actions for each input; rather, it must learn only 
to associate different actions with different probability measures on [0,1) and thus 
must only perform a single learning task regardless of the variety of tasks the user 
wishes to perform. Third, some of the learning can be transferred to users, who 
can modify their actions to be better recognized by the interface. 

Since RTIAC simply requires learning the associations between the user's actions 
and the points within the unit interval, and since it can be used with a wide variety 
of input devices and combinations thereof, individual users have extensive freedom 
in how they interact with an RTIAC interface. Those wishing to avoid the neg- 
ative health effects of sedentary computing might train the interface to respond 
to video-monitored movements providing a vigorous exercise routine. Ergonom- 
ically conscious users may navigate the interface with varied motions to prevent 
injuries associated with unvarying posture and continuous keyboard or mouse use. 
Others may choose to combine normal computer use with practicing a specific ac- 
tivity; for example, after having trained the interface to associate different pitches 
with different regions of [0, 1), one could practice singing or playing intervals while 
simultaneously writing a text file. 

5. DISCUSSION 

Drawing from information theory, statistics, and machine learning, the RTIAC 
methods presented in this paper are an important step toward intelligent user inter- 
faces that anticipate user's intentions in order to minimize the user's time and effort 
required for performance of tasks. By combining the underlying input probability 
distribution of IAC data entry [Ward et al. 2000] with individualized of models how 
a user's intentions are signaled by his/her actions, RTIAC user interfaces should 
allow for more rapid data entry, accommodation of users with disabilities and un- 
reliable input devices, and greater flexibility in how users interact with computers. 
Due to the simplicity of the idea and past research in the areas upon which the 
RTIAC draws, there are no substantial obstacles to the creation of such interfaces. 

Nevertheless, a number of outstanding issues must be resolved before the advan- 
tages of RTIAC can be fully exploited. An obvious challenge is the development 
of highly effective interface layouts, which is especially pertinent in the case of 
RTIAC interfaces for operating systems and multi-program suites fi )4.2[) . A more 
subtle question relates to the fact, mentioned in £|4.5[ that users can modify their 
behavior in response to mismatches between their intentions and the interpreta- 
tion of their actions by the RTIAC interface; how can this co-learning by the user 
and computer be managed to minimize the time required to complete the learning 
process and/or to maximize the rate of information transfer in the final state to 
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which the learning converges? For example, rather than simply learning to respond 
to the user's actions, the interface could be designed to induce the user to make 
more varied actions that more effectively distinguish between the possible inputs. 
This latter issue is related to the former, since the layout of the user interface will 
influence the user's actions and thus affect the co-learning procedure. Identifica- 
tion and development of the most appropriate learning algorithms and hypothesis 
spaces, which may depend on the interface layout and the medium through which 
the user communicates, is also important. 
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